{"query": "Why did Mary pay off the debt for Ann's family?", "gt": "Mary was in love with Ann.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Mary paid the debt out of compassion.", "evaluation": "f1"}
{"query": "After Ann passes away, with whom did Mary fall in love?", "gt": "She fell in love with Henry.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Mary fell in love with her father's servant.", "evaluation": "f1"}
{"query": "What makes you think that Mary will have a short life?", "gt": "Mary is not healthy and the story implies that she will die young.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 13 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the text, Mary's life is likely to be short because she is described as having a \"consumption\" and a \"delicate constitution,\" which suggests that she is fragile and may not live for long.", "evaluation": "f1"}
{"query": "Which of her children does Eliza favor over the other?", "gt": "Eliza favors her son over her daughter.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the text, Eliza favors her son over her daughter.", "evaluation": "f1"}
{"query": "How is Mary initially educated?", "gt": "She educates herself using books and the natural world.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Mary is initially educated by an old housekeeper.", "evaluation": "f1"}
{"query": "What does Eliza, on her death bed, request of her daughter Mary?", "gt": "Eliza requests that Mary marry Charles.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Eliza requests Mary to read the Bible.", "evaluation": "f1"}
{"query": "Who do Mary and Ann meet is Lisbon?", "gt": "The duo meet Henry on their travels to Lisbon.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question with 9 words:\n\nMary and Ann meet a Frenchman in Lisbon.", "evaluation": "f1"}
{"query": "What does Mary do when she hears that Henry's consumption has worsened?", "gt": "She cares for him until he dies.l", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Mary visits Henry in the country.", "evaluation": "f1"}
{"query": "Why does Ann not return Mary's feelings of affection?", "gt": "Because Ann is already involved in an unrequited love.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Ann does not return Mary's affection because she is selfish.", "evaluation": "f1"}
{"query": "What Does Socrates state he should do instead of breaking the law?", "gt": "He should try and persuade the Laws to let him go.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Socrates states he should not break the law and instead accept his fate.", "evaluation": "f1"}
{"query": "What does a citizen willingly do if they agree to live in Athens?", "gt": "Endorse and abide by the laws.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  A citizen willingly obeys Athens' laws.", "evaluation": "f1"}
{"query": "Who persuades Socrates to escape?", "gt": "Crito convinces Socrates to leave his cell. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Crito persuades Socrates to escape.", "evaluation": "f1"}
{"query": "In the story, where does the dialogue take place?", "gt": "The dialogue takes place in Socrates' cell.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  The dialogue takes place in Socrates' prison cell.", "evaluation": "f1"}
{"query": "When did Crito visit Socrates?", "gt": "Crito visited in the early morning.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Crito visited Socrates early in the morning.", "evaluation": "f1"}
{"query": "What was the purpose of Crito's visit?", "gt": "To smuggle Socrates out of prison and into a life of exile.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  Crito visited Socrates to persuade him to escape from prison.", "evaluation": "f1"}
{"query": "What was the practical reasoning Crito used to try and convince Socrates to leave?", "gt": "Crito reasoned that his and his friends reputations would suffer for not having done enough to help Socrates.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 18 words.[/INST]", "llama2-13b-chat-4k_pred": "  Crito used practical reasoning to try and convince Socrates to leave by appealing to his fear of dishonor, the potential harm to his children, and the possibility of finding a better life elsewhere.", "evaluation": "f1"}
{"query": "What would Socrates do if the decision to leave his cell was unjust?", "gt": "He would stay and face his execution.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Socrates would not leave his cell unjustly.", "evaluation": "f1"}
{"query": "What economic statement is the source of a lot of anxiety to the Jews? ", "gt": "The statement \"Don't buy from Jews.\"", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The economic statement that is the source of anxiety to the Jews is: \"The Jewish Company.\"", "evaluation": "f1"}
{"query": "What did Herzl focus his efforts on?", "gt": "Securing official legal sanction from the Ottoman empire. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Herzl focused his efforts on a Jewish state.", "evaluation": "f1"}
{"query": "What type of neighborhood are the Jewish people living in?", "gt": "The Jews were living in Ghettos.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Jewish people are living in a hostile world.", "evaluation": "f1"}
{"query": "Herzl focused his political activity on the behalf of what belief system?", "gt": "Herz focused his political efforts on behalf of Zionism.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Herzl focused his political activity on the behalf of Zionism.", "evaluation": "f1"}
{"query": "What country is used as the example of a civilised country in which persecution still exists?", "gt": "France was given as an example. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 6 words:\n\n\"France is the example given.\"", "evaluation": "f1"}
{"query": "Why do the Jews seem to attract persecution where there wasn't any previously?", "gt": "The political question of if there is a good number or too many Jews hasn't been addressed, even in civilized countries.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 21 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Jews attract persecution due to their distinct identity and cultural differences, which can be perceived as threatening to the dominant culture.", "evaluation": "f1"}
{"query": "Why did Herzl want legal sanction from the Ottoman authorities?", "gt": "So the Jews could immigrate without persecution.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Herzl sought legal sanction for Jewish settlement.", "evaluation": "f1"}
{"query": "Why is immigration of Jews a problem in the story?", "gt": "The non-Jewish public fear their numbers", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Immigration of Jews a source of tension.", "evaluation": "f1"}
{"query": "How are the lower class Jews affected in the ghettos?", "gt": "The lower class Jews live in poverty and are destitute", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Lower class Jews in ghettos suffer from poverty and oppression.", "evaluation": "f1"}
{"query": "Was Herzl affiliated with Zionism?", "gt": "Only on behalf of them politically.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Yes, Herzl was the founder of Zionism.", "evaluation": "f1"}
{"query": "What did Lateesha plan to use to pay for her granddaughter's medical procedure?", "gt": "the finder's fee for returning the stolen money", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the given document, Lateesha planned to use her gigantic nail to pay for her granddaughter's medical procedure.", "evaluation": "f1"}
{"query": "How did Claremont know there would be $10 Million in the armored car?", "gt": "He owns the armored car company that transports money for Drake Bishop", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the given document, the answer to the question is: Claremont knew there would be $10 million in the armored car because he was involved in the heist and had prior knowledge of the money's presence.", "evaluation": "f1"}
{"query": "Who were the FBI initially led to believe would commit the robbery?", "gt": "Frances Cigluitti, his brother and two other friends", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  The FBI initially believed Drake Bishop committed the robbery.", "evaluation": "f1"}
{"query": "What happened when the bounty hunters tried to get the money from the trailer home?", "gt": "they had a shootout with Fender's mother", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Bounty hunters retrieve severed arm.", "evaluation": "f1"}
{"query": "Where did Frances' dad shoot Bishop?", "gt": "at the Stratosphere Hotel and Casino", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Bishop was shot in the chest.", "evaluation": "f1"}
{"query": "Where did the stolen money eventually end up?", "gt": "Some of it is used for Mica's. The rest goes to Afhan freedom fighters", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 14 words.[/INST]", "llama2-13b-chat-4k_pred": "  The stolen money eventually ended up in the possession of Drake Bishop, the owner of the Stratosphere Hotel & Casino.", "evaluation": "f1"}
{"query": "Who is Domino Harvey?", "gt": "A bounty hunter who works for a bail bondsman. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Domino Harvey is a tough, sexy bounty hunter.", "evaluation": "f1"}
{"query": "Why was she being investigated by the FBI?", "gt": "For a robbery of $10 million. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Domino Harvey under investigation for bounty hunting.", "evaluation": "f1"}
{"query": "What does Claremont find out about Francis?", "gt": "He finds out that Francis is the son of a mafia boss. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  Claremont finds out that Francis is a skilled hacker and tech expert.", "evaluation": "f1"}
{"query": "How does Kamala die?", "gt": "She is bitten by a snake.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Kamala dies of a broken heart.", "evaluation": "f1"}
{"query": "What advice does Vasudeva give Siddhartha about his son running away?", "gt": "To let him follow his own path.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Vasudeva advises Siddhartha to follow his heart.", "evaluation": "f1"}
{"query": "Siddhartha tell Govinda that for every true statement there is what?", "gt": "An opposite statement that is also true.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  For every true statement, there is evidence.", "evaluation": "f1"}
{"query": "How does Govinda finally find enlightenment?", "gt": "By kissing Siddhartha's forehead and seeing into the eternal circle of life and completeness that Siddhartha has experienced.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 18 words.[/INST]", "llama2-13b-chat-4k_pred": "  Govinda finds enlightenment by following Siddhartha's example and embracing the spiritual journey of self-discovery and introspection.", "evaluation": "f1"}
{"query": "Why does Siddhartha not join the Buddhist order when his friend does?", "gt": "Because he felt that it wasn't able to teach to an individual's unique struggles and needs.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 16 words.[/INST]", "llama2-13b-chat-4k_pred": "  Siddhartha chooses not to join the Buddhist order with his friend Govinda because he seeks a more individualized spiritual path.", "evaluation": "f1"}
{"query": "What effect does the desire for love have on Siddhartha?", "gt": "He is willing to live against his beliefs for the sake of the love of Kamala", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 16 words.[/INST]", "llama2-13b-chat-4k_pred": "  Siddhartha's desire for love and connection with others is a central theme in the text. It is evident that he is seeking a deeper sense of fulfillment and happiness beyond the teachings of his father and the expectations of his society. His desire for love and understanding is a driving force behind his decision to leave his home and become a Samana.", "evaluation": "f1"}
{"query": "What does Siddhartha do when he comes to grips with his rich but shallow lifestyle?", "gt": "He runs away to the river and thinks about killing himself.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Siddhartha leaves his comfortable life to seek spiritual enlightenment.", "evaluation": "f1"}
{"query": "Where do many of Siddhartha's revelations happen?", "gt": "Many of Siddhartha's revelations happen on the banks of the river.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Many of Siddhartha's revelations happen under the Banyan tree.", "evaluation": "f1"}
{"query": "Why is the house off limits after her death?", "gt": "Because of the traumatic experience of listening to the sounds in her closet", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 13 words.[/INST]", "llama2-13b-chat-4k_pred": "  The house is off limits after her death because the will forbids trespassing on enclosed property.", "evaluation": "f1"}
{"query": "Madame de Merret threatened to leave her husband if he did what?", "gt": "If he looked into the closet where he had heard a noise.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided document, the instruction is to answer the following question with 12 words:\n\nMadame de Merret threatened to leave her husband if he did what?", "evaluation": "f1"}
{"query": "How did the husband make sure the closet would never open again?", "gt": "He hired a mason to come and wall it off", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  The husband sealed the closet with glue to ensure it never opened again.", "evaluation": "f1"}
{"query": "What is La Grande Breteche?", "gt": "The ruins of an abandoned manor. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  La Grande Breteche is an old, abandoned house.", "evaluation": "f1"}
{"query": "How long until someone will be permitted to enter La Grande Breteche?", "gt": "50 years after the owner's death.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The answer to the question is: Never.", "evaluation": "f1"}
{"query": "What did Madam de Merret's husband discover about her?", "gt": "That she was having an affair. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Madam de Merret was insane.", "evaluation": "f1"}
{"query": "Who was responsible for making sure no one entered the house? ", "gt": "The local lawyer at the inn.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The owner, Madame de Merret, was responsible for ensuring no one entered the house.", "evaluation": "f1"}
{"query": "Where is Monsieur de Merret returning home from when he catches his wife by and her lover by surprise?", "gt": "He has been away on a business trip.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question:\n\nMonsieur de Merret was returning home from Paris.", "evaluation": "f1"}
{"query": "Where were Jacob and his fellow soldiers stationed during the war?", "gt": "in a village in the Mekong Delta.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question:\n\nJacob and his fellow soldiers were stationed in Vietnam.", "evaluation": "f1"}
{"query": "What is the fatal injury that Jacob sustains which ultimately leads to his death?", "gt": "A bayonete stabbing to his gut.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question:\n\nFatal injury: Knife wound to the chest.", "evaluation": "f1"}
{"query": "The experimental drug \"The Ladder\" which was given to Jacob's platoon induces what effect?", "gt": "It greatly increased aggression against others. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The experimental drug \"The Ladder\" induces hallucinations.", "evaluation": "f1"}
{"query": "Why does the lawyer hired by Jacob and the other men in his unit drop their case?", "gt": "He finds files stating they were never in combat and all received a psychiatric discharge.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 15 words.[/INST]", "llama2-13b-chat-4k_pred": "  The lawyer drops the case because he is convinced by the government's evidence that the men's experiences were hallucinations caused by a new drug called \"Jodie.\"", "evaluation": "f1"}
{"query": "Who is Meister Eckhart?", "gt": "A 14th century mystic who described Hell.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Meister Eckhart is a medieval German mystic.", "evaluation": "f1"}
{"query": "Who created \"The Ladder\"?", "gt": "The US Army chemical weapons division.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question with 6 words:\n\n\"The Ladder\" was created by Bruce Joel Rubin.", "evaluation": "f1"}
{"query": "What mementos does Jacob find when he returns to his family's home?", "gt": "His dog tags and honorable discharge from the army.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the given document, the mementos that Jacob finds when he returns to his family's home are:\n\n1. A photograph of his father.\n2. A locket with a picture of his mother.\n3. A letter from his grandfather.\n4. A pocket watch.\n5. A family heirloom, a silver cross.", "evaluation": "f1"}
{"query": "How does Jacob first meet Michael Newman?", "gt": "Newman treated Jacob's injuries on the medevac out of Vietnam", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question with 10 words:\n\nJacob first meets Michael Newman in the subway station.", "evaluation": "f1"}
{"query": "On October of 1971, where was Joseph deployed to during the Vietnam war?", "gt": "A village in the Mekong Delta ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question:\n\nJoseph was deployed to Vietnam in October 1971.", "evaluation": "f1"}
{"query": "Why does Jacobs lawyer back out of the case?", "gt": "Military files show that the platoon members were discharged due to psychological reasons and that they never actually saw combat.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 20 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 20 words:\n\nJacob's lawyer backs out of the case because he is afraid of the supernatural elements involved in Jacob's story and feels that he cannot provide adequate representation.", "evaluation": "f1"}
{"query": "When Jacob finds himself strapped to a stretcher, what do the doctors tell him that he ultimately denies?", "gt": "They tell him that he is dead", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  The doctors tell Jacob he is delusional.", "evaluation": "f1"}
{"query": "What does the drug that Micheal created do?", "gt": "It makes people crazy and homicidal", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The drug causes hallucinations and paranoia.", "evaluation": "f1"}
{"query": "After seeing the light, why does Jacob finally let go and die?", "gt": "He lets go of his memories and attachments ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question in 8 words:\n\nJacob lets go and dies from exhaustion.", "evaluation": "f1"}
{"query": "What is Sir Robert's profession?", "gt": "He is a member of the British House of Commons.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sir Robert Chiltern is a government minister.", "evaluation": "f1"}
{"query": "What does Mrs. Cheveley attempt to backmail Sir Robert?", "gt": "She wants Sir Robert to support an illegial scheme to build a canel in Argentina.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 15 words.[/INST]", "llama2-13b-chat-4k_pred": "  Mrs. Cheveley attempts to blackmail Sir Robert by threatening to reveal his past misdeeds if he doesn't give her the deed to the lead mine.", "evaluation": "f1"}
{"query": "What do Mabel and Lord Goring find at the party?", "gt": "A diamond brooch that Lord Goring gave someone years ago.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Mabel and Lord Goring find each other and fall in love.", "evaluation": "f1"}
{"query": "What happened to the Argentinian canal scheme?", "gt": "It was denounced by Sir Robert", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Argentinian canal scheme failed.", "evaluation": "f1"}
{"query": "In Lady Chilterns's opinion what is a \"ideal husband\"?", "gt": "An ideal spouse both in private and public that she can worship", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  In Lady Chiltern's opinion, an ideal husband is one who is charming, witty, and devoted to his wife, but also strong-willed and independent.", "evaluation": "f1"}
{"query": "What does Lord Caversham announce before the house in the final act?", "gt": "That Sir Robert's has denounced the Argentine Canal", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Lord Caversham announces the engagement of Mabel Chiltern and Lord Goring.", "evaluation": "f1"}
{"query": "Who's name is the letter addressed to that Sir Robert reads in the final act?", "gt": "The addressee's name is not mentioned", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The letter is addressed to Lady Chiltern.", "evaluation": "f1"}
{"query": "How does Sir Robert interpret the letter he reads?", "gt": "As a letter asking for forgiveness", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sir Robert interprets the letter as a threat.", "evaluation": "f1"}
{"query": "What did Roy see on the body he identified in the motel room?", "gt": "There wasn't a cigar burn on the corpse's hand. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Roy saw a tattoo of a snake on the body.", "evaluation": "f1"}
{"query": "What does Lilly do to get out of late rent with her landlord?", "gt": "She offers sex to forget the rent", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, Lilly gives her landlord a bracelet to pay her late rent.", "evaluation": "f1"}
{"query": "What does Myra say Roy did to Lilly?", "gt": "Myra accuses Roy of having an incestuous interest in Lilly", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the text, Myra says Roy did something to Lilly that made her angry.", "evaluation": "f1"}
{"query": "How is Lilly punished for missing a race with a big payout in La Jolla?", "gt": "Bobo burns her hand with a cigar?", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Lilly is punished by losing her job.", "evaluation": "f1"}
{"query": "How is it known that Roy lied when he identified the dead body as his mother to the FBI?", "gt": "The corpse did not have a cigar burn to the hand.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided text, it is known that Roy lied when he identified the dead body as his mother to the FBI because he was seen by a bartender using a sawed-off baseball bat to kill the woman, and he was seen taking the ten dollar bill from the bartender after the act.", "evaluation": "f1"}
{"query": "What accusation does Myra make of Roy after he turns down her offer?", "gt": "Myra accuses Roy of having an incentuous flame for his mother.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the text, Myra accuses Roy of being a thief after he turns down her offer.", "evaluation": "f1"}
{"query": "Why does Lilly claim Roy literally does not have the stomach for the grift?", "gt": "She is being sarcastic in response to his internal bleeding after being punched in the stomach.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 16 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, the answer to the question is: Roy gets physically sick when he is about to commit a crime, which Lilly observes and uses to her advantage.", "evaluation": "f1"}
{"query": "How does Lilly try to seduce Roy?", "gt": "She tells Roy he is not her son.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided text, Lilly tries to seduce Roy by using her beauty and coldness to attract him and make him vulnerable to her manipulation.", "evaluation": "f1"}
{"query": "How does Lilly show her concern for Roy when he's receiving medical assistance?", "gt": "She threatens to kill the doctor if Roy dies.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Lilly displays empathy by gently holding Roy's hand.", "evaluation": "f1"}
{"query": "Why is Cara being followed by the Police?", "gt": "Because her lover was wanted for not paying millions in back taxes and they thought she would lead them to the man.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 22 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 22 words:\n\nCara is being followed by the police because she is suspected of involvement in a high-stakes jewel heist.", "evaluation": "f1"}
{"query": "What were Pearce's written instructions to Cara?", "gt": "Board the train to Venice, pick out a man and make the Police believe that he is Pearce.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 18 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 18 words:\n\nAccording to Pearce's written instructions to Cara, she was to board the Orient Express and select a man of approximate height and weight to accompany her to Venice.", "evaluation": "f1"}
{"query": "What did Frank do for a living?", "gt": "He was a math teacher at a community college in America.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, Frank is a tourist who is on his honeymoon. He is a cheerful American who is not very sophisticated and is easily embarrassed. He is also a bit of a clumsy romantic, as he manages to spill his drink on Cara's dress and later gets his zipper stuck on her sweater. Despite these mishaps, Cara seems to be enjoying Frank's company and is amused by his obliviousness.\n\nAs for Frank's profession, the document does not explicitly state what he does for a living. However, based on his casual attire and the fact that he is on his honeymoon, it can be inferred that he is not a high-powered businessman or a wealthy individual. Instead, he may be a regular working-class person who is taking a break from his daily life to enjoy a romantic vacation.", "evaluation": "f1"}
{"query": "Once Cara got to Venice, what new instructions did Pearce give to her?", "gt": "Pearce told Cara to attend a ball.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, the new instructions given to Cara by Pearce in Venice were to \"select a man of approximate height and weight.\"", "evaluation": "f1"}
{"query": "Why did the Italian Police say they were detaining Frank?", "gt": "They detained him for his own safety.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question:\n\nThe Italian police said they were detaining Frank because he was a suspicious person.", "evaluation": "f1"}
{"query": "What is revealed about Cara?", "gt": "She is an undercover Scotland Yard Agent who is under suspension because of her suspected relationship with Pearce.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 18 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, the following is revealed about Cara:\n\nShe is a mysterious woman on a train, possibly involved in espionage or blackmail.", "evaluation": "f1"}
{"query": "What does Frank tell Ackerman when he confronts him?", "gt": "That he is really Pearce, not an American Tourist.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's my answer:\n\nFrank tells Ackerman he's a spy on a mission.", "evaluation": "f1"}
{"query": "What does Chief Inspector Ackerman order his men to do when he arrives on the scene?\n", "gt": "He orders the snipers to fire.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 6 words:\n\nChief Inspector Ackerman orders men to secure perimeter.", "evaluation": "f1"}
{"query": "What is in the safe?", "gt": "The money that was needed to pay back the taxes.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the answer to the instruction with 10 words:\n\n\"The microchip is hidden in a hollowed-out book.\"", "evaluation": "f1"}
{"query": "Why don't the Police chase Pearce after he escapes?", "gt": "Because the back taxes were now paid up.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 8 words:\n\n\"Pearce has a fake identity, so police can't trace him.\"", "evaluation": "f1"}
{"query": "What is Soames unhappy about?", "gt": "His obscurity and failure as a poet.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Soames is unhappy about his lack of success.", "evaluation": "f1"}
{"query": "Where did Soames go in the future to learn more about his fate?", "gt": "The Reading Room of the British Museum.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Soames's fate remains a mystery.", "evaluation": "f1"}
{"query": "What does Soames request of his friend before departing to Hell?", "gt": "That he attempts to let people known Soames existed.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question with 9 words:\n\nSoames requests his friend's opinion of his book.", "evaluation": "f1"}
{"query": "How do we know the people in the museum aware of Soames' presence?", "gt": "They stared at him, followed him, and seem afraid of him.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  The people in the museum are oblivious to Soames' presence.", "evaluation": "f1"}
{"query": "What did T.K. Nupton think of Soames' existance?", "gt": "He thought he was a fictional character.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  T.K. Nupton thought Soames barely existed.", "evaluation": "f1"}
{"query": "How long was Soames in the future?", "gt": "About 4 hours and 50 minutes in the afternoon.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Soames was in the future for 18 years.", "evaluation": "f1"}
{"query": "Which remarkable habit did Enoch Soames demonstrate with regard to choice of clothing?", "gt": "always wore a grey waterproof cape and a soft black hat", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Enoch Soames demonstrated a habit of wearing the same outfit every day.", "evaluation": "f1"}
{"query": "According to the deal Soames made, how would he find out whether his poetic talent would have been recognized in the future? ", "gt": "By spending an afternoon in the Reading Room of the British Museum 100 years ahead of his time", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 18 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the given document, the instruction is to answer the following question in 18 words:\n\nQuestion: How would Soames have found out if his poetic talent would have been recognized in the future?\n\nAnswer: Soames would have found out if his poetic talent would have been recognized in the future by the reception of his book \"Negations\" and the opinions of readers and critics.", "evaluation": "f1"}
{"query": "What is unique about the phonetic spelling of the 'future' article that discussed Beerbohm's story? ", "gt": "The spelling of most words is modified, presumably because of the change of language with time", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 16 words.[/INST]", "llama2-13b-chat-4k_pred": "  The unique phonetic spelling of the 'future' article in Beerbohm's story is the use of the word \"wud\" instead of \"would.\"", "evaluation": "f1"}
{"query": "Why doesn't Brian Clough like Leeds?", "gt": "Because of their rough style and play", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question \"Why doesn't Brian Clough like Leeds?\" in 7 words:\n\n\"Brian Clough doesn't like Leeds because they're dirty.\"", "evaluation": "f1"}
{"query": "Why did Clough assumed that Revie would acknowledge him?", "gt": "Because they were from the same town and played on the same team", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 13 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 13 words:\n\n\"Clough assumed Revie would acknowledge him because he was the successful manager of Derby County.\"", "evaluation": "f1"}
{"query": "Who is signed by Clough and Taylor?", "gt": "Dave Mackay and several other players.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Damned United is a film about Brian Clough's appointment as the manager of Leeds United Football Club in 1974, and the challenges he faces in taking over from the previous manager, Don Revie. Based on the document, here are some key points that could be summarized:\n\n1. Brian Clough is appointed as the new manager of Leeds United Football Club, replacing Don Revie.\n2. Clough is a modern, cocky, and handsome contrast to the more traditional and conservative Revie.\n3. Clough's arrival is met with mixed emotions by the players, who are used to Revie's strict discipline and are skeptical of Clough's unconventional methods.\n4. Clough faces challenges in winning over the players and the board of directors, who are still loyal to Revie.\n5. Clough's outspoken criticism of Revie and his tactics has made him unpopular with some of the players and the club's hierarchy.\n6. Clough's vision for the club is to bring a more attractive, attacking style of play and to create a more positive and family-like atmosphere within the club.\n\nAs for answering questions based on the document, here are a few possible questions and answers:\n\nQuestion: What was the reason for Don Revie's departure from Leeds United Football Club?\nAnswer: Don Revie left the club to become the manager of the England national football team.\n\nQuestion: What was Brian Clough's approach to managing Leeds United?\nAnswer: Clough aimed to bring a more attractive, attacking style of play to the club and to create a more positive and family-like atmosphere within the club.\n\nQuestion: How did the players react to Clough's arrival?\nAnswer: The players were initially skeptical of Clough's unconventional methods and were loyal to Revie.", "evaluation": "f1"}
{"query": "Why does Clough Use his best squad in the last match?", "gt": "Because of his pride and determination", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question:\n\n\"To prove a point to Revie.\"", "evaluation": "f1"}
{"query": "To whom will Clough threaten a sever punishment?", "gt": "Any player mentions the former manager's name", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 7 words:\n\nBilly Bremner, the club captain.", "evaluation": "f1"}
{"query": "Who is Revie known for researching?", "gt": "Every opponent his team has faced", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 6 words:\n\nDon Revie researched Brian Clough.", "evaluation": "f1"}
{"query": "Why was Alf Ramsey replaced?", "gt": "He failed to qualify for the 1974 FIFA World Cup.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 10 words:\n\nAlf Ramsey was replaced because he was not successful enough.", "evaluation": "f1"}
{"query": "When did the conflict between Leeds and Clough begin?", "gt": "In a 1968 FA World Cup match.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  The conflict began with Clough's criticism.", "evaluation": "f1"}
{"query": "What was the robbery about?", "gt": "The robbery was about stealing a bunch of diamonds.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  The robbery was about a group of men stealing money from a restaurant.", "evaluation": "f1"}
{"query": "Why did Orange shot Blonde?", "gt": "Blonde was going to set Nash on fire.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Orange shot Blonde for talking too much.", "evaluation": "f1"}
{"query": "Why did white pointed his gun at Orange head?", "gt": "Orange told White he is an undercover  policeman.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  White pointed gun at Orange's head in anger.", "evaluation": "f1"}
{"query": "Which man is angry and thinks the job is a set up?", "gt": "Mr. Pink believes the cops are involved and that the diamond heist is a setup.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 15 words.[/INST]", "llama2-13b-chat-4k_pred": "  The angry man is Mr. White, who thinks the job is a set up and is upset about tipping.", "evaluation": "f1"}
{"query": "Who does Eddie leave in charge of Nash and Orange?", "gt": "Eddie leaves Mr. Blonde in charge.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the instruction with 6 words:\n\nEddie leaves Nash and Orange in charge.", "evaluation": "f1"}
{"query": "Who ends up getting the diamonds?", "gt": "Mr. Pink takes the diamonds and flees.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the instruction with 7 words:\n\nJoe Cabot keeps the diamonds.", "evaluation": "f1"}
{"query": "How does Eddie Cabot Die?", "gt": "Eddie dies in a Mexican Standoff.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Eddie Cabot dies in a shootout.", "evaluation": "f1"}
{"query": "Who kills Mr. White?", "gt": "The police who found White and Orange.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 7 words:\n\nMr. Blonde shoots Mr. White.", "evaluation": "f1"}
{"query": "Who are the two men that do not use aliases?", "gt": "The mob boss: Joe Cabot, and his son: Eddie Cabot.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  The two men who do not use aliases are \"Nice Guy Eddie\" and \"Joe Cabot.\"", "evaluation": "f1"}
{"query": "When Blonde resumes torturing Nash, what does he do to try to get more information?", "gt": "Blonde cuts off Nash's right ear with a straight razor.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Blonde resumes torturing Nash, trying to get more information.", "evaluation": "f1"}
{"query": "After discovering Blonde is dead, what does Orange tell Eddie, White and Pink about what happened?", "gt": "Orange tells them that Blonde was planning to kill them and steal all of the diamonds.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 16 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question:\n\nOrange tells Eddie, White, and Pink that Blonde is dead and that he saw Joe Cabot shoot him.", "evaluation": "f1"}
{"query": "What happens when Joe finds out about Orange and attempts to execute Orange?", "gt": "White interrupts and holds Joe at gunpoint.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Joe executes Orange for betrayal.", "evaluation": "f1"}
{"query": "What did the Gridlestones do to create a favorable impression?", "gt": "Made a small donation to charity.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Gridlestones were religious and moral.", "evaluation": "f1"}
{"query": "Whose influence does Girdlestone want to use?", "gt": "A collector, who is a Member of Parliament.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Girdlestone wants to use his son Ezra's influence.", "evaluation": "f1"}
{"query": "What will this \"discovery\" of diamonds do?", "gt": "Plunge the price of diamonds to avoid ruin.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  The discovery of diamonds will cause a rush of prospectors.", "evaluation": "f1"}
{"query": "Why did the plan fail?", "gt": "The agent found diamond mines in South Africa", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  The plan failed due to a lack of commitment.", "evaluation": "f1"}
{"query": "What does his friend's will state about the daughter?", "gt": "If she dies before coming of age, John becomes the sole heir.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  According to the will, the daughter inherits a large sum of money.", "evaluation": "f1"}
{"query": "What is John's final plan to regain riches for the firm?", "gt": "He wants to kill the daughter to save the firm.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  John's final plan is to invest in the diamond trade.", "evaluation": "f1"}
{"query": "What does Ezra try to do with the girl in order to get to her inheritance?", "gt": "Tries to romance her and fails ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Ezra tries to marry the girl.", "evaluation": "f1"}
{"query": "How did John keep the impending bankruptcy from Ezra?", "gt": "By showing him a dummy ledger", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  John hid the truth from Ezra.", "evaluation": "f1"}
{"query": "What is discovered after the Girdlestone's spend all their money buying diamonds?", "gt": "A diamond mine in South Africa", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Girdlestone's discover a fraud.", "evaluation": "f1"}
{"query": "How Jenny's wounds healed after the car crash?", "gt": "Starman uses Silver Sphere to heal Jenny", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Benny's wounds healed with medical attention.", "evaluation": "f1"}
{"query": "How does Starman get money after Jenny loses her wallet?", "gt": "He wins on a slot machine.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Starman uses advanced technology.", "evaluation": "f1"}
{"query": "The alien gives Jenny the final silver sphere with what instructions? ", "gt": "Starman tells Jenny that her son will know what to do with it. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 13 words.[/INST]", "llama2-13b-chat-4k_pred": "  The alien gives Jenny the final silver sphere with instructions to \"fix position for rescue.\"", "evaluation": "f1"}
{"query": "What was the Voyager 2 carrying?", "gt": "a gold phonographic disc that invited aliens to come to Earth.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Voyager 2 was carrying a golden record with Earth sounds.", "evaluation": "f1"}
{"query": "What ends up happening to the alien craft when it approaches Earth?", "gt": "The US government decides to shoot it down instead of welcoming it.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  The alien craft escapes Earth's gravity and hurtles into the night sky.", "evaluation": "f1"}
{"query": "What do the silver spheres allow Starman to do?", "gt": "They provide energy for him to perform amazing things.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  The silver spheres allow Starman to fly and communicate.", "evaluation": "f1"}
{"query": "Why is the alien trying to reach the rendezvous point?", "gt": "He must reach it because if he does not within 3 day he will die.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 15 words.[/INST]", "llama2-13b-chat-4k_pred": "  The alien is trying to reach the rendezvous point to be rescued and escape the hostile environment of Earth.", "evaluation": "f1"}
{"query": "What causes Jenny to stay with the alien?", "gt": "She witnesses the alien revive a dead deer.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided script, it appears that Jenny stays with the alien because she is drawn to its advanced technology and the power it represents.", "evaluation": "f1"}
{"query": "What features and abilities will Jenny's baby have?", "gt": "The baby will be the son of Scott, but also possess all of Starman's knowledge and will become a teacher.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 20 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the screenplay, Jenny's baby will have the following features and abilities:\n\n* Advanced intelligence and technology\n* Ability to communicate telepathically\n* Possibility of having superhuman strength and agility\n* Potential for advanced sensory perception and intuition\n* May have a unique connection to the alien spacecraft and its technology.", "evaluation": "f1"}
{"query": "How are Jenny and the alien able to purchase a new car after traveling too far?", "gt": "Starman uses a quarter in a slot machine and manipulates it to win the five hundred thousand dollar jackpot.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 19 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question with 19 words:\n\nJenny and the alien use their advanced technology to purchase the new car online, bypassing traditional financing and ownership requirements.", "evaluation": "f1"}
{"query": "How does the army become involved in the capturing of Starman?", "gt": "George Fox discovers the original destination of Starman and arranges to have him captured dead or alive.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 17 words.[/INST]", "llama2-13b-chat-4k_pred": "  The army becomes involved in the capturing of Starman when the spaceship lands in a housing tract and the humanoid figure escapes, causing chaos and destruction. The police call for backup, and the army is deployed to contain the situation and capture the alien.", "evaluation": "f1"}
{"query": "How was Leonard  Lowe able to communicate with Dr. Malcolm Sayer?", "gt": "By means of a Ouija board", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Leonard Lowe communicated through painting.", "evaluation": "f1"}
{"query": "What was the ailment Dr. Sayer patients suffer from?", "gt": "They were in a catatonic state.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided document, the ailment that Dr. Sayer's patients suffer from is not specified. The document only mentions that the patients are living with profound neurological disease, but it does not provide any specific information about the nature of their illnesses. Therefore, the answer to the instruction should be \"not specified\" or \"not provided.\"", "evaluation": "f1"}
{"query": "What happened to Leonard Lowe when he became agitated while arguing with Dr. Sayer and the staff?", "gt": "He started to suffer hard to control facial and body tics", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the given document, here are the instructions to answer the question:\n\nQuestion: What happened to Leonard Lowe when he became agitated while arguing with Dr. Sayer and the staff?\n\nInstructions: Answer the question in 11 words.\n\nNote: The given document is a screenplay, and the character Leonard Lowe is a patient at Bainbridge Hospital. The scene describes how Leonard becomes agitated while arguing with Dr. Sayer and the staff, and the consequences that follow.", "evaluation": "f1"}
{"query": "How did Sayer learn about the L-Dopa drug?", "gt": "He attended a lecture about its use in treating Parkinsons.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided document, there are several instructions that need to be followed:\n\n1. Summarize the document: The provided document is a screenplay titled \"Awakenings\" based on the book by Oliver Sacks. It tells the story of a man named Leonard who has a rare neurological disorder and is being treated with a new drug called L-Dopa. The screenplay explores Leonard's journey and the impact of the drug on his life.\n2. Answer questions based on the document:\na. How did Sayer learn about the L-Dopa drug?\n\nAnswer: Sayer learned about the L-Dopa drug from his research on earthworms.\n\nb. What is the main theme of the screenplay?\n\nAnswer: The main theme of the screenplay is the power of medical discovery and the impact it can have on people's lives.\n\nc. What is the name of the hospital where Leonard is being treated?\n\nAnswer: The name of the hospital is Bainbridge Hospital.\n\nd. What is the name of the doctor who is treating Leonard?\n\nAnswer: The name of the doctor is Dr. Kaufman.\n\ne. What is the name of the drug that is being used to treat Leonard's condition?\n\nAnswer: The name of the drug is L-Dopa.\n\nf. What is the name of the patient who is talking to Sayer in the corridor?\n\nAnswer: The name of the patient is Anthony.\n\ng. What is the name of the orderly who is escorting Anthony?\n\nAnswer: The name of the orderly is Anthony.\n\nh. What is the name of the old patient in the wheelchair who is greeted by Anthony?\n\nAnswer: The name of the old patient is not specified.\n\ni. What is the main conflict of the story?\n\nAnswer: The main conflict of the story is Sayer's struggle to prove himself as a neurologist and his desire to help his patients, despite his lack of experience and training.", "evaluation": "f1"}
{"query": "Why does Sayer ask Nurse Eleanor Costello out for coffee?", "gt": "She had previously asked him, and asking her is part of his own awakening.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 14 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the instruction with 14 words:\n\nSayer asks Nurse Eleanor Costello out for coffee because he is attracted to her and hopes to get to know her better.", "evaluation": "f1"}
{"query": "Aside from Sayer and the patients, who else experiences a kind of awakening in the story?", "gt": "The nurses are more kind, and Paula keeps visiting Leonard.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  The patients experience an awakening as they interact with Sayer.", "evaluation": "f1"}
{"query": "When does Sayer start noticing the breakdown of Leonard's awakening?", "gt": "Leonard has uncontrollable tics after the revolt.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sayer notices breakdown in Leonard's awakening on page 6.", "evaluation": "f1"}
{"query": "Why is Paula at the hospital?", "gt": "She is the daughter of another patient.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, the instruction is to answer the question \"Why is Paula at the hospital?\" in 7 words. Here is the answer:\n\nPaula is at the hospital for treatment.", "evaluation": "f1"}
{"query": "What did Virgil Sollozzo ask Vito for?", "gt": "For an investment into his narcotics business and protection.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, Virgil Sollozzo asked Vito Corleone for a favor.", "evaluation": "f1"}
{"query": "Who does Michael kill?", "gt": "Vigil \"The Turk\" Sollozzo and Marc McCluskey.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Michael kills Sollozzo and McCluskey.", "evaluation": "f1"}
{"query": "What happens to Appolonia after her marriage to Michael?", "gt": "She is killed in a car bombing.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the document, after her marriage to Michael Corleone, Appolonia becomes a powerful and respected member of the Corleone family.", "evaluation": "f1"}
{"query": "How does Vito move to end the feuds?", "gt": "He tells the five families that he will stop trying to avenge his son's murder.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 15 words.[/INST]", "llama2-13b-chat-4k_pred": "  Vito Corleone, the Godfather, resolves the feuds by mediating between the warring families and imposing his authority as the head of the Corleone family.", "evaluation": "f1"}
{"query": "Why is Luca Brasi sent to spy on Virgil \"The Turk\" Sollozzo? ", "gt": "He asked Vito for investment in his narcotics business and for protection with his political connections.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 16 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to your question:\n\nLuca Brasi was sent to spy on Virgil \"The Turk\" Sollozzo because the Corleone family suspected that Sollozzo was working with the rival Tattaglia family to undermine their power.", "evaluation": "f1"}
{"query": "How does Apollonia Vitelli, Michael's first wife die?", "gt": "In a car bomb meant for Michael", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Apollonia Vitelli dies in a car bombing.", "evaluation": "f1"}
{"query": "When do Corleone assassins kill the other New York Dons and Moe Greene?", "gt": "While Michael is standing at the alter for Connie's baby's christening", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Corleone assassins kill the other New York Dons and Moe Greene in the following scenes:\n\n* Don Tattaglia is killed by Virgil Sollozzo and Albert Neri in the hospital parking garage (Scene 12)\n* Moe Greene is killed by Fredo Corleone and Peter Clemenza in his office (Scene 15)\n* The other New York Dons are killed by the Corleone family in a series of violent confrontations and power struggles throughout the film.", "evaluation": "f1"}
{"query": "When is the meeting between Micheal and Don Barzina set o take place?", "gt": "The same day as the christening of Connies baby", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  The meeting between Michael and Don Barzina is set to take place after the wedding.", "evaluation": "f1"}
{"query": "Why is Ted afraid of flying?", "gt": "He was a fighter pilot in was", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the document with the instructions:\n\nPlease summarize the document in 50 words or less:\n\nAirplane! is a comedy film about a group of passengers on a flight from Chicago to Los Angeles. The passengers include a religious zealot, a businessman, a blonde, and a family. The film follows their journey as they deal with various challenges, including a hijacking attempt and a plane crash.\n\nNow, please answer the following questions based on the document:\n\n1. What is the main setting of the film?\n2. Who is the main character of the film?\n3. What is the central conflict of the film?\n4. What is the tone of the film?\n5. What is the genre of the film?\n\nFinally, please write a required paragraph based on the document:\n\nThe film Airplane! is a hilarious comedy that follows the misadventures of a group of passengers on a flight from Chicago to Los Angeles. With a diverse cast of characters, including a religious zealot, a businessman, a blonde, and a family, the film is full of witty one-liners and physical humor. Despite the challenges they face, including a hijacking attempt and a plane crash, the passengers keep their spirits high and manage to find the humor in their situation. Overall, Airplane! is a lighthearted and entertaining film that will leave audiences laughing.", "evaluation": "f1"}
{"query": "Why did so many people on the plane fall ill?", "gt": "They fall ill because of food poisoning from fish dinner.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the summary of the document:\n\nThe document is a script for the movie \"Airplane!\" and it includes various scenes and characters, as well as some humorous dialogue and situations. The story follows a group of people at an airport and on a plane, and their various experiences and interactions. The document also includes some instructions for the reader, such as to answer a question with 10 words. Overall, the document is a comedic and lighthearted take on air travel and the people involved in it.\n\nPlease let me know if you have any specific questions or if there's anything else I can help with!", "evaluation": "f1"}
{"query": "What is the one thing that the autopilot can not do?", "gt": "Autopilot can not land the plane", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the document with the instructions you requested:\n\nPlease summarize the document in 50 words or less:\n\nAirplane passengers and airport staff experience chaos and confusion as a plane crashes into a terminal building. The document includes a series of announcements, conversations, and scenes that build up to the crash.\n\nNow, please answer the following questions based on the document:\n\n1. What is the name of the airport where the plane crashes?\n2. What is the name of the flight that crashes into the terminal building?\n3. Who is the main character in the document?\n4. What is the reason for the plane crash, according to the document?\n5. What is the final message of the document?\n\nThank you!", "evaluation": "f1"}
{"query": "Who does Ted require a pep talk from in order to land the plane?", "gt": "Rex Kramer, his old commanding officer", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question:\n\nTed requires a pep talk from Elaine.", "evaluation": "f1"}
{"query": "What traumatized Ted Striker?", "gt": "His time in an unnamed war", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the summary of the document:\n\nThe document is a script for the movie \"Airplane!\" It includes a variety of characters and scenes, including a religious zealot, a hare krishna, a businessman, and a ground crewman. The script also includes a number of humorous lines and situations, such as a character named Elaine who is trying to help a man named Ted Striker work through his issues, but he is not interested in listening to her. The script ends with a scene of the plane crashing into the terminal building.\n\nAs for the questions based on the document, here are a few possibilities:\n\n1. What is the main conflict of the story?\n2. What is the significance of the white and red zones in the airport?\n3. What is the relationship between Elaine and Ted Striker?\n4. What is the humorous element of the scene with the ground crewman?\n5. What is the climax of the story?\n\nI hope this helps! Let me know if you have any other questions.", "evaluation": "f1"}
{"query": "Who is Elaine Dickson?", "gt": "Ted's former girlfriend, now a flight attendant", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the summary of the provided document:\n\nThe document is a script for the movie \"Airplane!\" It includes various scenes and characters, as well as dialogue and instructions for the actors. The story follows a group of passengers and airport staff as they deal with a crisis caused by a hijacking. The script is written in a humorous and satirical style, with many jokes and one-liners.\n\nThe document includes the following characters and scenes:\n\n* Elaine Dickson, a stewardess who is the main character of the story\n* Ted Striker, Elaine's husband who is a pilot\n* A group of religious zealots who try to convert people in the airport\n* A group of passengers, including a businessman, a blonde, and a family with an eight-year-old son\n* A ground crew who direct planes to the correct gate\n* A forklift driver who is responsible for loading and unloading luggage\n* A group of police and airport security who try to stop a hijacking\n\nThe script includes various themes, such as marriage, religion, and air travel. It also includes many humorous moments, such as when the businessman tries to get a taxi and the driver is not paying attention, and when the blonde spits on the wall.\n\nOverall, the document is a script for a comedy movie that pokes fun at various aspects of air travel and modern society.", "evaluation": "f1"}
{"query": "Who is Rex Kramer?", "gt": "Ted's former commanding officer in the war who helps him land the plane.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 13 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the document with the instructions:\n\nPlease summarize the document in 100 words or less:\n\nThe document is a script for the movie \"Airplane!\" and includes various scenes and characters. The story follows a man named Ted Striker who is trying to win back his ex-wife Elaine, who is a stewardess on a flight. The script includes various comedic moments and characters, such as a religious zealot, a businessman, and a ground crewman.\n\nNow, please answer the following questions based on the document:\n\n1. Who is the main character of the story?\n2. What is the main conflict of the story?\n3. What is the setting of the story?\n4. What is the tone of the story?\n5. Can you describe one of the comedic moments in the story?\n\nPlease answer these questions in 100 words or less. Thank you!", "evaluation": "f1"}
{"query": "What happens after Dr Rumack's pep talk with Ted?", "gt": "Ted was able to land the plane safely.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 8 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here's the answer to the question:\n\nCaptain Clarence buys a magazine and continues reading.", "evaluation": "f1"}
{"query": "Why are the pilot and co-pilot unable to fly the plane?", "gt": "They've become ill from food poisoning.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the document with the instructions:\n\nPlease summarize the document in 50 words or less:\n\nAirplane passengers and crew members experience a chaotic and hilarious night at the airport, with misunderstandings, miscommunications, and mishaps leading to a series of absurd and humorous situations.\n\nNow, please answer the following questions based on the document:\n\n1. What is the main theme of the document?\n2. What is the setting of the document?\n3. Who are the main characters in the document?\n4. What is the tone of the document?\n5. What is the mood of the document?\n\nFinally, please write a required paragraph based on the document:\n\nAs the passengers and crew members navigate the chaotic and hilarious night at the airport, they encounter a series of absurd and humorous situations that highlight the absurdity and unpredictability of life. Despite the challenges and misunderstandings, the characters in the document come together to create a memorable and entertaining experience that will leave readers laughing and smiling.", "evaluation": "f1"}
{"query": "What does Max manage to do while escaping from a gang?", "gt": "He is able to crash two of the gang members vehicles and also injure Wez.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 15 words.[/INST]", "llama2-13b-chat-4k_pred": "  Max manages to escape from the gang by using his supercharger to surge away and outrun them.", "evaluation": "f1"}
{"query": "Who does Max go to for help and what do they utilize?", "gt": "Max goes to Gyro Captain and finds the truck with his gyrocopter.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 12 words.[/INST]", "llama2-13b-chat-4k_pred": "  Max goes to the Gyro Captain for help and utilizes his knowledge of the wasteland.", "evaluation": "f1"}
{"query": "What do the defenders want Max to do after he returns?", "gt": "They want Max to escape with them, but he declines.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Based on the provided document, the defenders want Max to return with fuel for the community.", "evaluation": "f1"}
{"query": "How does Max's break through the siege end?", "gt": "He fails as Wez runs Max's car off the road, destroying his vehicle and severely injuring him.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 17 words.[/INST]", "llama2-13b-chat-4k_pred": "  Max uses his supercharger to blast through the siege, leaving the Marauders behind.", "evaluation": "f1"}
{"query": "After Max leaves the compound, how do the other inhabitants end up escaping?", "gt": "They are able to escape because Humungus and his warriors pursue the tank that Max is trying to escape in.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 20 words.[/INST]", "llama2-13b-chat-4k_pred": "  The other inhabitants of the compound escape by using a secret underground tunnel that leads to the outside world, which was built by the compound's founder as a contingency plan in case of emergencies.", "evaluation": "f1"}
{"query": "What ends up killing Wez and Humungus?", "gt": "Max drives straight into Humungus' car causing a head on collision.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Wez and Humungus are killed by a group of Marauders.", "evaluation": "f1"}
{"query": "What happens to the Gyro Captain?", "gt": "He becomes the chief and leads the settlers to the coast to start the Great Northern Tribe.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 17 words.[/INST]", "llama2-13b-chat-4k_pred": "  The Gyro Captain is captured by the Marauders.", "evaluation": "f1"}
{"query": "Who is Max Rockatansky?", "gt": "He is a ex-main Force Patrol officer. ", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 7 words.[/INST]", "llama2-13b-chat-4k_pred": "  Max Rockatansky is a road warrior.", "evaluation": "f1"}
{"query": "Why is Harney exploring buildings?", "gt": "Because he is preparing for a book on colonial houses", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Charity Royall is confused by Lucius Harney's questions.", "evaluation": "f1"}
{"query": "What did Mr. Royall do after the death of his wife?", "gt": "Tried to force himself into Charity's bedroom and asks her to marry him.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 13 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the answer to the question with 13 words:\n\nAfter the death of his wife, Mr. Royall became a widower and lived alone.", "evaluation": "f1"}
{"query": "What does Mr. Royall tell Harney when he notices how close Harney and Charity become?", "gt": "Mr. Royall tells Harney he may no longer board with him.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 11 words.[/INST]", "llama2-13b-chat-4k_pred": "  Sure! Here is the answer to your question:\n\nMr. Royall tells Harney that Charity is a hardworking and intelligent young woman.", "evaluation": "f1"}
{"query": "During which event does Charity see Harney with Annabel?", "gt": "A charity during Old Home's Week", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Charity sees Harney with Annabel at Nettleton.", "evaluation": "f1"}
{"query": "What secret does Ally accidentally share with Charity about Harney?", "gt": "That he is engaged to Annabel", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 6 words.[/INST]", "llama2-13b-chat-4k_pred": "  Ally shares Harney's true identity.", "evaluation": "f1"}
{"query": "How does Charity feel about her life in North Dormer at first?", "gt": "Charity is bored with life in North Dormer at first.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 10 words.[/INST]", "llama2-13b-chat-4k_pred": "  Charity feels trapped and longs for adventure beyond North Dormer.", "evaluation": "f1"}
{"query": "What did Charity do for her job?", "gt": "Charity was a librarian and ward of Mr. Royall.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Charity Royall worked as the librarian.", "evaluation": "f1"}
{"query": "How did Chartiy reveal to Harney that she had married Mr. Royall?", "gt": "She reveals that information to Harney in a letter.", "prompt": "[INST]<<SYS>>\nNow you are given a very long document. Please follow the instruction after this document. These instructions may include summarizing a document, answering questions based on the document, or writing a required paragraph. \n<</SYS>>\n\nDocument is as follows. {} Instruction: {} \nAnswer this question with 9 words.[/INST]", "llama2-13b-chat-4k_pred": "  Charity revealed to Harney that she had married Mr. Royall by saying, \"I saw you going into her house just now, didn't I?\"", "evaluation": "f1"}
